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Abstract 

In this paper, we consider situations in which a given logical func- 
tion is realized by a multithreshold threshold function. In such situ- 
ations, constant functions can be easily obtained from multithreshold 
threshold functions, and therefore, we can show that it becomes pos- 
sible to optimize a class of high-order neural networks. We begin by 
proposing a generating method for threshold functions in which we 
use a vector that determines the boundary between the linearly sep- 
arable function and the high-order threshold function. By applying 
this method to high-order threshold functions, we show that functions 
with the same weight as, but a different threshold than, a threshold 
function generated by the generation process can be easily obtained. 
We also show that the order of the entire network can be extended 
while maintaining the structure of given functions. 

1 Introduction 

Threshold elements are considered to have the potential for being the compo- 
nents of systems with high-order information-processing capabilities. The- 
oretical analysis is currently being carried out on this mathematical model 
[JJ. By adding conditions to the threshold functions that determine the 
logical operations of threshold elements, construction and optimization of 
networks of a certain class become easier. One example of constructing net- 
works with threshold elements involves self-dual threshold functions, which 
comprise a subset of the entirety of threshold functions: it has been shown 
that the structure of a high-order function in the same class can be obtained 
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using the sum of the weights of two functions that differ [2]. Because the 
conditions attached to functions contribute to network optimization, there 
have also been studies focusing on the characteristics of threshold functions 
[3], [1]. However, because functions realizable by single-threshold functions 
are restricted to the linearly separable class, studies are being carried out 
on high-order threshold functions in which terms that consist of the product 
of input variables are being attached to the threshold function [5]- [8]. This 
approach allows arbitrary logical functions to be realized. As one example of 
constructing a high-order neural network, it has been shown that, by focus- 
ing on the monotonicities (a condition required for a given logical function to 
be a threshold function), it becomes possible to create high-order threshold 
functions that realize monotonic functions of a certain class [9], |10| . Fur- 
thermore, as an alternative to the method of high-order terms of high-order 
threshold functions, the use of a monotonic multilayer function, which uses 
multiple threshold functions and exclusive disjunctions, has been proposed 
However, using these functions to specify the operations of network 
elements require a discrete approach; the analysis of this becomes difficult, 
and thus few theoretical investigations have been performed. In this pa- 
per, by focusing on input vectors characterizing the high-order threshold 
functions and using the qualities of multithreshold threshold functions, we 
show a method by which high-order terms of a certain class of high-order 
threshold functions can be easily removed. We also show that multithresh- 
old threshold functions can be embedded in high-order threshold functions, 
and that the order of high-order threshold functions can be easily extended, 
while maintaining their structure. 

2 Preliminaries 

This section gives mathematical expressions for the high-order threshold 
function and the multithreshold threshold function, and also terminology, 
to form a basis for Section 3. 

Let the set composed of and 1 be B = {0, 1}. The n-fold direct product 
of B is written as B n : 

B n = {(x 1 ,x 2 , . . . ,x n ) \xieB,ie {1,2, ... ,n}}. 

The set of all real numbers is written as 3?. 

Definition 1. The function G from B n to 5? is defined as follows. For 
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X = (xi, X2, • • • , x n ) € B n , we define 

n 

G (X^) — ^ ^ CLiXi -\- ^ ^ Q-iii-iXii Xi 2 + ' ' ' + ^ ^ ^ii ' ' ' 3?i r j 

i=l l<ii<i2<n l<ii <---<i r <n 

(1) 

where all dj, a^,..., Oj 1 ...i r are real-valued, r is a positive integer not 
greater than n. 

Using the above G, the function 5 from £? n to .B is defined as follows. 
For X = (x±,X2, • • • , x n ) G -B n , we define 

r 1 ifc># 

^ I otherwise, 

where is a real- valued. The above 5 is called an n- variable high-order 
threshold function. In G, if there exist i\ • • • i r satisfying 1 < i\ < ■ ■ ■ < 
i r < n, such that a^...^ 7^ 0, r is called the order of <?. When there exist 
multiple r, such as r = 1,2,..., the maximum of r is defined as the order 
of g. When r = 1, g is a threshold function. is called the threshold of <?, 
and aj, 0^43, . . . , a^...^, are called the weight of g. Unless otherwise stated, 
an n-variable high-order threshold function of order r is simply called a 
high-order threshold function. 

Definition 2 QlJ). If A; threshold functions fx, /2 • • •, fk can be generated 
by changing the threshold and keeping the weights constant, these functions 
are said to share the same weight. This is denoted by 

~ (/lj/2 •••,/*:)■ 

Definition 3. Let g be an n-variable high-order threshold function of 
order r. Consider the input vector Y G B n for g. Y is called the high-order 
vector of g only when /, as defined by 

f(Y) = l-g(Y), 
f(X) = g (X) , (X^Y, XeB n ), 

is a high-order threshold function of order s (7^ r). The generating process 
for function / by Eq. ([2]) is denoted by g — > f. 

Definition 4. Let k threshold functions of n variables be expressed 
as hi, i G {1,2,..., k}. For Xj G B n , j G {1, 2, . . . , 2 n }, h, defined in 
the following equation, is called a multithreshold threshold function or a 
^-threshold threshold function. 

k 

h(Xj) = J2 h i( X j) m ° d 2 - 
i=l 
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Definition 5 QlJ). If an n- variable logic function / is m-asummable with 
respect to a given m, this means that for k (2 < k < m), no pair of true 
vectors Xu\ or false vectors Xu\ exists that satisfies the following equation: 

k k 
i=l j=l 

In Eq. ([3]), Xu\ and Xu\ allow for overlapping in both the left- and right- 
hand sides. If / is m-asummable for m (> 2), / is said to be asummable. 

Theorem 1 (Asummability Theorem [I]). A necessary and sufficient con- 
dition for a given logic function f to be a threshold function is that f is 
asummable. 

3 Extending the Order of High-Order Threshold 
Functions 

In this section, we show that given a high-order threshold function, a thresh- 
old function can be obtained by focusing on high-order vectors. We also 
show that the structure of given multithreshold threshold functions can be 
maintained when extending the order of the high-order threshold functions. 

Theorem 2. Let g represent an n-variable high-order threshold function 
of order r (> 2). Then /2 represents an n-variable threshold function ob- 
tained by the following equation in relation to the n- order input vector Y . 

9 ^ h- (4) 
If a given n-variable function f\ satisfies 

fi = 9®h, (5) 

then the order of a high-order threshold function that realizes fi is expressed 
by r = 1. 

Proof. By Eq. if fi (obtained by replacement of the function value of 
g in relation to input vector Y) is a threshold function, then Y is a high-order 
vector of g. From Definition [3l because 

g (Z) = f 2 (Z) 
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is established with regard to input vector Z G {B n \ Y}, 

g (Z) e h (z) = o 

is obtained. Therefore, there is only one true vector for the n-variable func- 
tion fi expressed in Eq. ©. Given that a pair of true vectors does not exist 
in regard to /i, fi is a threshold function, from Theorem [TJ Thus, the point 
in question holds. □ 

Theorem 3. Let f n represent an n-variable high-order threshold function 
of order r (> 2). The two n-variable threshold functions denoted by 

~ {fn' fn) 

in relation to n (> 2) are called fn and f%. If the equation 

fn = f\®fl (6) 

is established, then the (n + l)-variable function f n +i expressed by the fol- 
lowing equation is a two-threshold threshold function. 



where 



fn+l= 9n+l(B f n+1 ® fn+l, (7) 
9n+l {X, X n+ i) = Xn~^ ■ f n V X n+ i ■ f n , (8a) 

f n+1 (X,x n+ i) = Xn~+T ■ f n V X n +l ■!, ie {1, 2} , (8b) 
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in relation to X E B 

Proof. By Eq. (JHaJ) , the (n + Invariable function g n +\ is an n-variable 
function degenerated by variable x n +i, so 

9n+l = fn (9) 
holds. From Eqs. (|8a|) . ()8bp . and ©, Eq. ([7]) can be transformed as follows: 

fn+l = XnTI • {fn © /„ © /^) V ■ / n . (10) 

It is clear from Eq. ([6]) that f n ®f n ®fn = so Eq. (flOl) then becomes 

fn+l = %n+l • V X n+ \ ■ f n , 

and f ri +i has the same structure as f n in the case x n +i = 1- By Eq. 
(@, /n is a two-threshold threshold function. In addition, from Eq. (TTOj) . 
the input vectors satisfying x n +i = are all false vectors, and thus new 
threshold functions are unnecessary for realizing / n +i. Therefore, the point 
in question holds. □ 
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4 Conclusions 



In this paper, we generated threshold functions on the basis of high-order 
vectors. Specifically, we showed that when a function is realized by multiple, 
separate functions with the same weight but different thresholds, by using 
the fact that constant functions can be obtained from these functions, the 
derivation of threshold functions can be easily made. We also showed that 
the order of high-order threshold functions can be easily increased while 
maintaining the structure of a given multithreshold threshold function. This 
may provide one foothold in improving the information-processing capacity 
of entire networks while maintaining previous functions. One important 
topic in the future will be the theoretical examination of functions with 
various characteristics. 
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